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(54) Method for reducing temporal artifacts in digital video systems 



(57) A method and system for improved display of 
digital video data The data Is arranged Into bit planes 
according to the binary weight of each bit per pixel. The 
bit planes are then translated into non-binary weighted 
bit planes by bit translation circuitry (22). These non- 
binary bit planes are transmitted to the activation circuitry 



of a spatial light modulator an-ay (30). such that each 
non-binary bit Is displayed at symmetrical times around 
at least one predetermined point within a video frame 
time, eliminating visual artifacts associated with binary 
pulse-width modulation. 
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Description 

BACKGROUND OF THE INVENTION 

1. Reld of the Invention 5 

This invention relates to display systems using spa- 
tial light modulators, more particularly to the data han- 
dling for such systems. 

2. Background of the Invention 

Spatial light modulators have many different forms. 
A common for has an array of individually addressable 
elements, each of which represent a picture element in 
an image being displayed. Two examples of spatial light 
modulators are the liquid crystal display devices (LCD) 
and the digital micromirror device (DMD, also known as 
the deformable mirror device). 

The liquid crystal device typically functions as a 
transmissive modulator. The optical system is positioned 
such that the light passes through the LCD. The individ- 
ual elements are activated and deactivated to t)lock or 
transmit the light to the screen. They can also control the 
color. The DMD is a reflective modulator, with the optical 
system positioned to allow the individual elements to 
either reflect light to the screen or away from it. The indi- 
vidual elements typically receive a signal that causes the 
mirror to deflect in one direction or another. When it 
deflects in one direction, the light is reflected to the 
screen, when it deflects in the other direction, light is 
moved away from the screen. 

Because of the ease of turning these elements, 
whether transmissive or reflective. ON and OFF. it is sim- 
ple to operate them digitally using binary data. One prob- 
lem with digital operation arises from a common form of 
pulse width modulation. In order to achieve varying levels 
of intensity (gray levels), in color or not, is to control the 
amount of time each level is on digitally For example, for 
16 levels of intensity, each element would have 4 bits of 
data. In binary weighting, the most significant bit (MSB) 
would be given 8/1 5 of the available time, such as a video 
frame time, to display its data. The next MSB would be 
given a 4/15. the next to least significant bit (LSB) would 
be give 2/15 and the LSB would receive 1/15. 

The various combinations of these bits' on times 
including black, totals up to 16 levels of intensity. How- 
ever, tills manner of addressing can lead to visual arti- 
focts in the image. For example, if in one frame, a pixel 
has an intensity level of 7, it would require the three low- 
est bits (bits 0, 1 and 2) to all be ON, and the MSB, (bit 
3) to be OFF. If in the next frame, the level is 8. which is 
only one level away, all of the bits must change intensi- 
ties. The MSB would be ON. when it had been OFF 
before. The other 3 bits must then all turn OFF. when they 
had been ON. This point in the scheme, where every bit 
is changing state will be referred to as a bit transition. 
This causes visual artifacts in the image, taking away 
from the clarity and resolution of the image displayed. 



Therefore, a method of preventing these artifacts 
while maintaining a good level of resolution is needed. 

SUMMARY OF THE INVENTION 

It is possible to use a non-binary weighting system 
to eliminate the visual artifacts at a bit transition. The bits 
are weighted in a non-binary fashion according to the 
system requirements. This weighting is programmed into 
a logic circuit. When the incoming data, most likely a dig- 
itization of a video signal, or possibly a digital video sig- 
nal, passes through the circuit, it is converted to the new 
non-binary weighting. This new weighting is then used 
in displaying the data. Because the new weighting does 
not have extensive bit transitions, it eliminates or signif- 
icantly reduces the visual artifacts caused by these tran- 
sitions. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present 
invention and for further advantages thereof, reference 
is now made to the following Detailed Description tal^n 
in conjunction with the accompanying Drawings in which: 

Rgure 1 shows a schematic example of a circuit to 
translate from binary to non-binary bit weights. 

Figure 2 shows a graphical example of 5 binary bits 
translated to 8 non-binary weighted bits. 

Rgure 3 shows a standard 8 binary bits frame time 
and its resulting pattern. 

Rgure 4 shows a graphical example of 6 binary bits 
translated to 8 non-binary weighted bits. 

Rgure 5 shows a graphical example of 8 binary bits 
translated into 12 non-binary weighted bits. 

Figure 6 shows another graphical example of 8 
binary bits translated into 12 non-binary bits. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

One embodiment of spatial light modulators include 
anrays of separate elements, each individually address- 
able. They can operate in either digital or analog fashion. 
The digital modulators are becoming very popular for dis- 
play systen)s. These individually addressable elements 
typically consist of an active area, either reflective or 
transmissive (sometime referred to as pixels), and some 
type of activation circuitry. The activate circuitry causes 
the active area to become active. For example in liquid 
crystal displays (LCD), electrodes on one side of a piece 
of glass cause the crystalline material to activate and 
block or not block the light received on that element. 

The addressing for these elements is complex and 
suffers from several time constraints. The first constraint 
is the minimum time necessary to load the data. For spa- 
tial light modulators consisting of arrays of individual ele- 
ments, this can result in several different enrfoodiments. 
Loading the entire array takes a certain period of time, 
which usually becomes the amount of time the least sig- 
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n'rficant bit (LSB) is displayed. This minimum number 
depends upon the number of bits for the system. 

The second constraint is the maximum time availa- 
ble for the display of a video frame of data. Using a 60 
Hz system, the frame time is typically one frame in 1 /60th s 
of a second, or 16.67 milliseconds (msecs). This 
assumes a mono-color system. Color systems are done 
several ways using spatial light modulators. One way is 
to use a white light source with some sort of filter, such 
as a color wheel, and allowing only 1/3 of the 16.67 io 
msecs for each color. 

Additional ways include using either a white light 
source and three separate filters, with one modulator per 
filter, actually coloring the individual elements red, green 
or blue, or using three separate light sources. The follow- is 
ing discussion assumes that each nrKxiulator receives 
the total frame time for display. To adapt it to a one 
source/three color system, the patterns would merely 
need to be triplicated and the timing adjusted. 

An 8 bit system has 255 levels of intensity. There- 20 
fore, the LSB must have 1/255 of the total frame time, 
which is typically 16.67 msecs. The data for the entire 
array must then be loaded during [16.67 msecs/255], or 
65.4 microseconds (10"6). Obviously the data rate to 
support this is prohibitively high, or the number of input 2S 
lines would be prohibitively high. Even for a standard res- 
olution array of 640 rows by 480 columns with 640 input 
drivers (one per column) the data rate would be [480 
bits/85.4 microseconds], or 7 megabits/second. 

Some system modifications have occurred that 30 
make this impossibly high data rate obtainable. The use 
of shift registers and multiplexing/demultiplexing data 
have lowered this rate to a more obtainable one. One 
recent innov€rtion is the use of block reset and split reset 
approaches. 35 

In block reset, a subarray of the elements are reset 
as a block. The data for the LSB is displayed for the LSB 
time, then the subarray displaying that data is reset and 
"blacked out" for another LSB time. Hits allows the load 
time to be extended and decreases the burst data rate. 40 

The split reset architecture has numerous individual 
elements, or pixels, assigned to one memory cell. This 
way. not as many memory cells must receive data. The 
array is again divided into subarrays. although now by 
the reset circuitry. A typical array may have 16 reset 45 
groups, or suk>arrays. 

Any of the three approaches can use the embodi- 
ments of the invention. The discussion will center around 
the split reset approach, since that is the most likely 
method of operation of a spatial light modulator array. A so 
circuit 10 for translating the binary resolution bits into 
non-binary weighting is shown if Figure 1 . This circuit can 
be used for any type of array addressing, be it split reset, 
block reset or straight addressing as discussed above. 

The color video data stream 12 goes through a ss 
degamma process. Since cathode ray tubes have a non- 
linear response curve, a gamma correction signal is 
added at the broadcasters. Since spatial light modulators 
have a linear response, this signal must t>e removed, and 



is done so with a degamma circuit 14. If the incoming 
signal is a digital video stream with an assumed linear 
response, the degamma will not be necessary. 

Tlie data stream 1 6 from the degamma circuity may 
be of a higher resolution than the spatial light modulator's 
pulse-width modulation scheme. Therefore it needs to 
be adjusted down, and is done so by the intensity diffu- 
sion filter 18. The adjusted data stream 20 then has the 
correct resolution for the spatial light modulator, but is 
probak>ly in rasterized format. Rasterized format typically 
has the data in lines, which is difficult for most spatial 
light modulators to use. 

TTie arrays off a spatial light modulator normally 
receive data along column address drivers, so the data 
needs to be reformatted to achieve this. The bit transla- 
tion logic 22 accomplishes this by arranging the data for 
the columns and by storing it in bit planes. Each bit plane 
has only that data for a given significance level. For 
exanple. bit plane 0 has data for every pixel , but only the 
MSB for every pixel, it is followed by bit plane 1 , etc. Also 
the bit translation logic will convert the binary bits into 
the appropriate translated bits and place those into bit 
planes. This logic could be contained in a look-up table, 
a processor or many other types of circuitry. 

The bit plane data 24 is then passed to the frame- 
store 26, typically some kind of random access memory 
(RAM). The frame storage stores all of the bit planes for 
a given frame of video data. Often, there are two frame 
stores, one is emptied out and the data is sent to the 
array circuitry while the other is being filled. The 
sequence control processor 32 governs the seqilience of 
the bit planes and their timing. In the case of split reset, 
it will also control the synchronization for the various 
reset groups and their data. 

Rnally, the bit plane data 28 is passed to the spatial 
light modulator arrays 30. There may be one modulator 
array with a white light source, in which case the 
sequence control processor will also control the bit 
planes by color. Anotiier possibility is tiiree modulators, 
each with a colored light source. Regardless, using the 
present invention, the data arriving at the activation cir- 
cuitry for the array will be translated, non-binary data. 

Tlie system requirements drive what type of trans- 
lation is done. In one embodiment, the pixel intensity res- 
olution is reduced so that the non-binary bits can be 
stored, with no Increase in memory. A second embodi- 
ment retains the same intensity resolution, but uses 
more memory. One advantage of both of these 
approaches is that they eliminate the visual artifacts 
resulting from binary bit transitiona 

Figure 2 shows a graphical example of how a 5 bit 
binary system can be translated into an 8 bit non-binary 
system. The example shown assumes that the array of 
pixels is divided into 1 6 reset groups. In order to eliminate 
the visual artifects, it is desirable to split the time for each 
bit weight ( or bit plane) irrto 2 pieces and put them on 
either side of the mid-point of tiie frame time. Using the 
load time for one reset group as a one time period, the 
slices shown for t^it 3 are each 16 time periods. Since 
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there are two time periods on either side of the center 
region, bit 3 now has a bit weight of 32. 

Unlike a binary system, each bit will not have a dis- 
tinct bit weight. As can be seen from the time slices 
shown, bits 3, 4. 5, and 6 all have the same bit weight of s 
32. Bit 7 has two 16 period time slices and two 20 (a 16 
period plus 4 extra periods) period time slices for a total 
weight of 72. Obviously, this could not be a binary weight- 
ing system, since 72 is not an exponential of 2. 

The lower order bits are somewhat more difficult to 
defina Since they have time periods less than the 
amount of time it takes to load the array, tiiey must be 
set using either split reset or block reset. The point 40 is 
the mid-point both the frame period and the vertical 
extent of the array. BitO must be loaded ontotwodifferent 
subarrays at different times. If it were loaded on two dif- 
ferent subarrays at the same time, the minimum value 
achievable for bit 0 would be 1 6. Since it is loaded on half 
the array, it can be loaded with a minimum time of 8. It is 
loaded symmetrically about the center of the time period 
and the anay. 

Bit 1 and bit 2 must be used to even out the asym- 
metry caused by bit 1. Bit 1 has a weight of 16. and is 
divided into two pieces to fill the frame. Bit 2 has a weight 
of 24, since to even out the asymmetry it must have a 
length equal to bit 0 + bit 1 , or 16 + 8. The total time of 
the bit displaying process must fill out the frame time, 
which here has been assumed to be 16.67 msecs. This 
non-binary example uses 8 memory bits to represent 
gray levels 0-31 where a binary code uses only 5. The 
extra bits are used to produce a bit code that minimizes 
changes in light patterns at gray level transitions (bit tran- 
sitions). For instance, bits 3. 4. 5 and 6 are all 32 time 
periods long and could be used interchangeably, but, by 
using bit 3 for all levels above 6 and using bit 4 lor all 
levels above 10. etc., the light pattern expands is a sut>- 
stantially smoother fashion as gray levels increase. 

The resulting graph at the bottom of Rgure 2 shows 
the gray levels over the time of the frame period. When 
compared to the graph of Figure 3, which shows the 
standard 8-bit binary pattern, one can see the difference 
made by the non-binary approach. The graph in Figure 
3 is for an 8-bit split reset pattern in which bits 0-4 have 
been compacted much as bits 0-2 were in the graph of 
Figure 2. 

Figure 4 shows another example of a bit translation. 
In this embodiment, 6 binary bits are translated into 8 
non-binary bits and 64 gray levels are achieved. Again, 
the bit weights, order, and coding are chose to minimize 
light pattern changes for gray level (bit) transitions). 

There is a trade-off in this approach of levels of inten- 
sity for reduction of visual artifacts. In this example, the 
bit weights are as follows: Bit 0 (LSB) = 4; Bit 1 » 8; Bit 
2 = 16: Bits 3-4 = 32; Bits 5-6 = 36; and Bit 7 (MSB) = 
88. How the bits are arranged within the frame time is a 
very complex process which trades off the requirements 
of loading bits with no group to group conflict and smooth 
changes in light patterns with small gray level shifts. 



' 6 

Another way to adjust the bit patterns in a non-binary 
fashion to eliminate visual artifacts is shown in Figures 
5 and 6. In these embodiments, more bits are used to 
translate fewer bits, 1 2 bits toeing used to translate 8 bits. 
This alternative allows for tiie same resolution, but adds 
more memory, since 4 additional bit planes must be 
stored. 

Rgure 5 shows a tiie above approach where the bits 
are arranged around the mid-point of the frame in a sub- 
stantially symmetrical fashion. The bit weights are the 
same as the binary example of Figure 3 for bits 0-4 while 
bits 5-1 1 are all weighted 32. This yields a sum of 255 
which is required for 8 bits. 

In Figure 6, 12 bits are again used to translate 8. but 
tiie more than just tiie mid-point of ttie frame is used. In 
tills example, the mid-point is used for compacted bits 0- 
4, and the quarter-frame points are used for a continuous 
display of bit 6. The quarter-frame points are the points 
in time 1/4 and 3/4 the way through the frame period. 
This resulte In the graph shown at the bottom of the page, 
with effectively three peaks of brightness across the 
frame time. Depending upon the system parameters, 
such as processing speed, pin count (leading to data 
rate), lamp brightness, etc., this approach may be better 
for some systems. 

In summary, two approaches for the elimination of 
visual artifacts from pulse-widtii modulation are availa- 
ble. In one approach, the number of levels of resolution 
is decreased slightiy. in the other, the amount of memory 
is increased. Both have the advantages of eliminating 
visual artifects from digital display systems with a rela- 
tively low drain on system resources. They also allow for 
flexibility and can be adjusted for several different system 
configurations. 

Thus, although there has been described to this 
point particular emkxxiiments of methods to reduce vis- 
ual artifacts in digital display systems, it is not intended 
that such specific references be considered as limita- 
tions upon the scope of tilts invention except in-so-far as 
set forth in the following daims. 

Claims 

1 . /Vn improved metiiod for displ^ing digital video data 
comprising: 

a. determining the time available for one frame 
of said data; 

b. arranging the bits of said data into binary 
weighted bit planes; 

c. translating said binary weighted bit planes 
into non-binary waghted bit planes such that a 
minimum number of changes in lit patterns 
occur with gray level transitions; and 

d. transmitting said non-binary bit planes to the 
activation circuitry of a spatial light modulator 
such that data for any given non-binary bit plane 
is displayed for time period proportional to said 
bit plane's weight. 
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2. The method of claim 1 wherein light on periods 
expand symmetrically from at least on pre-deter- 
mined pdnt within said time available. 

3. The method of daim 2 wherein said at least one pre- s 
determined point is the mid-point of said frame time. 

4. The method of daim 2 wherein said at least one pre- 
determined point includes the quarter frame time. 

10 

5. A system for Improved display of video data using a 
spatial light modulator, wherein said system 
includes: 

a. an intensity diffusion filter for adjusting the 75 
numt>er of digital bits per pixel in an incoming 
data stream to match a predetermined digital 
bits per pixel of said spatial light nnodulator; 

b. a bit translator which translates the binary 
weights of said digital bits per pixel to non-binary 20 
weights; 

c. a frame storage for storing said non-binary 
weighted digital bits in bit planes: and 

d. a sequence control processor for controlling 
the sequence In which said non-binary bit 25 
planes are transmitted to activation circuitry of 
said spatial light modulator. 
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